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(57) Abstract: The invention provides methods, systems and apparatus for assigning colornames (Fig. 4) to individual image pixels, 
and generating verbal description of color composition in images, suitable for a wide variety of infoimation processing applications 
(404). For an isolated image pixel (individual color sample or color value) an illustrative embodiment of this invention uses a prede- 
termined vocabulary of color names (405), and then generates a distance measure describing the best color match and corresponding 
color name for the given pixel. For the input image, an illustrative embodiment of this invention computes the simplified representa- 
tion of the scene, consistent with human perception, and uses the predetennined vocabulary, syntax rules, and metric to assign color 
names to all perceptually significant objects and regions and obtain the verbal description of the overall color composition. The 
invention is also applicable to other types of information signals, such as sequences of video frames, web pages, etc. 
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COLOR NAMING, COLOR CATEGORIZATION AND DESCRIBING COLOR 

COMPOSITION OF IMAGES 



TECHNICAL FIELD: 

The present invention is directed to digital images. It is more particularly directed to 
color management and color analysis methodologies. It is more specifically directed to 
color categorization, color naming, and color composition of images, video and 
multimedia objects. 



BACKGROUND: 

Color is one of the main visual cues and has been studied extensively on many different 
levels, starting from the physics and psychophysics of color, to the use of color principles 
in practical problems. These include accurate rendering, display and reproduction, image 
filtering, coding, retrieval, and numerous other applications in scientific visualization, 
computer graphics, image and video processing. Interestingly, although color naming 
represents one of the most common visual tasks, it has not received significant attention 
in the engineering community. Yet today, with rapidly emerging visual technologies and 
multimedia, and the development of sophisticated user interfaces and human-machine 
interactions, the ability to name individiial colors, point to objects of a certain color, and 
convey the impression of color composition becomes an increasingly important task. 
Color cues can be used in interactive visualization and computer graphics. Color naming 
facilitates natural user interface design. The extraction of higher-level color descriptors 
represents a challenging problem in image analysis and computer vision, as &ese 
descriptors often provide link to image content When combined with image 
segmentation, it would be advantageous to be able to use color naming to select objects 
by color, describe the appearance of the image and even generate semantic annotations. 
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For example, regions labeled as light blue and strong green may represent sky and grass, 
vivid colors are typically foxmd in man-made objects, while modifiers such as brownish, 
grayish and dark convey the impression of the atmosphere in the scene. 

The applications mentioned so far use a flexible computational model for color 
categorization, color naming or extraction of color composition (i.e. color appearance of a 
given scene or image to a human observer). Modeling himian behavior in color 
categorization involves solving, or at least providing some answers to several important 
problems. The first problem involves the definition of the basic color categories and 
**most representative examples", called prototypical colors, which play a special role in 
structuring these color categories. Another issue is how to expand the notion of basic 
color terms into a "general" yet precise vocabulary of color names that can be used in 
different applications. The next problem involves the definition of category membership. 
Although the idea that color categories are formed around prototypical examples has 
received striking support in many studies, the mechanisms of color categorization and 
category membership are not yet fiilly xmderstood. 

According to the theories postulated to explain human perception, color vision is initiated 
in retina where the three types of cones receive the light stimulus. The cone responses are 
then coded into one achromatic and two antagonistic chromatic signals. These signals are 
interpreted in the cortex, in the context of other visual information received at the same 
time and the previously accumulated visual experience (memory). Once the intrinsic 
character of colored surface has been represented internally, one may think that the color 
processing is complete. However, an ever-present fact about human cognition is that 
people go beyond the purely perceptual experience to classify things as members of 
categories and attach linguistic labels to them. Color is no exception. That color 
categories are perceptually significant can be demonstrated by die "striped" appearance of 
the rainbow. In physical terms, the rainbow is just a light with the wavelength changing 
smoothly from 400-700 nm. The unmistakable stripes of color in the rainbow suggest an 
experimental basis for the articulation of color into at least some categories. However, to 
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model color naming, it is not sufficient to define the color names as functions of the 
wavelength range. This would account only for pure monochromatic stimuli, which are 
very rare in real-world situations, and would also leave out non-spectral colors like 
brown, white and black. Breakthroughs in the current understanding of color 
categorization came from several sources. This includes a cross-cultural study, which 
studied the color naming behavior with subjects from variety of languages. Twenty 
languages were examined experimentally and another 78 through the literature review 
and discovered remarkable regularities in the shape of the basic color vocabulary. As a 
result of their study, a concept of basic color tarns were introduced which lead to work 
on defining the color categories correspondmg to these basic terms. Eleven basic terms 
were identified in EngUsh: black, white, red, green, yellow, blue, brown, pink, orange, 
purple and gray. Experiments also demonstrated that the humans perform much better in 
picking the "best example" for each of the color terms than m estabUshmg the boundaries 
between the categories. This lead to the definition of focal colors representing the centers 
of color categories, and the hypothesis of graded (frizzy) membership. Many later studies 
have proven this hypothesis, indicating that prototypical colors play a crucial role in 
internal representation of color categories, and the membership in color categories seem 
to be represented relative to the prototype. Unfortunately, the mechanism of color naming 
is still not completely understood. There exist few theoretical models of color nanung 
based expUcitly on neurophysiology of color vision and addressing the universaUty of 
color foci and graded membership. Apart tmm not being developed or implemented as 
full-fledged computational models, these have important drawbacks. In one model 
membership in color categories is formalized in terms of frizzy set theory, by allowing the 
objects to be members of a given set to some degree. In terms of color categories, this 
means that a focal or prototypical color will be represented as having a membership 
degree of 1 for it's category. Other, non-focal colors will have membership degrees that 
decrease systematically with the distance from the focal color m some color space. 
However, this model considers only four fuzzy sets (red, green, yeUow and blue), and 
supporting other color terms requires the introduction of new and ad hoc fuzzy set 
operations. Furthermore, it is not clear how the non-spectral basic color categories, such 
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as brown, pink and gray are to be dealt with, nor how to incorporate the learning of color 
names into the model. Another model defines four physical parameters of the stimulus: 
wavelength, intensity, purity and adaptation state of the retina. According to this model, 
the pre-cortical visual system performs analog-to-digital conversion of these four 
parameters, and represents eleven basic color categories as specific combinations of the 
quantized values. Although interesting for its attempt to take adaptation into account, this 
model is clearly a gross simplification, which cannot hold in general. 

Although color spaces allow for color specification in unambiguous manner, in everyday 
life colors are mainly identified by their names. Although this requires a fairly general 
color vocabulary and is far from being precise, identifying a color by its name is a method 
of communication that everyone understands. Hence, there were several attempts towards 
designing a vocabulary, syntax and standard method for choosing color names. The 
Mimsell color order system known to those skilled in the art, is widely used in 
applications requiring precise specification of colors. Examples include production of 
paints, textiles, etc. It is often used as an industry standard, complemented by MunselFs 
Book of Color which includes 1,200 precisely controlled samples of colors (chips). The 
chips are arranged such that unit steps between them are intended to be perceptually 
equal. Each chip is identified by a 3-part code. The brightness scale is represented by the 
Munsell value with black denoted by 0/ and white by 10/. Munsell chroma increases in 
steps of two (/2, /4, ... , /lO). The hue scale is divided mto 10 hues: red (R), yellow-red 
(YR), yellow (Y), green-yellow (GY), green (G), blue-green (BG), blue (B), purple-blue 
(PB), purple (P), red-purple (RP), each hue can be fiuther divided into ten sections. One 
notable disadvantage of the Munsell system for the color-based processing is the lack of 
the exact transform firom any color spaces to MimselL For example, a transform proposed 
by others is fairly complicated and sometimes inaccurate for certain regions of CIE XYZ. 

The first listing of over 3000 English words and phrases used to name colors was devised 
by Maerz and Paul and published in a Dictionary of colors. Even more detailed was a 
dictionary published by The National Bureau of Standards. It mcluded about 7500 
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different names that came to general use in specific fields such as biology, geology, 
philately, textile, dyes and paint industry. Both dictionaries include examples of rare or 
esoteric words, and the terms are listed m entirely unsystematic manner, making them 
unsuitable for general use. Following the recommendation of the Inter-Society Council, 
the National Bureau of Standards developed the ISCC-NBS dictionary of color names for 
267 regions in color space. This dictionary employs English terms to describe colors 
along the three dimensions of the color space: hue, brightness and saturation. One 
problem with the ISCC-NBS model is the lack of systematic syntax. This was addressed 
during the design of a new Color-Naming System (CNS). The CNS was based in part on 
the ISCC-NBS model. It uses the same three dimensions, however the rules used to 
combine words firom these dimensions are defined in a formal syntax. An extension of the 
CNS model, called the Color-Naming Method (CNM), uses a systematic syntax similar 
to the one described m the CNS model, and m^s the color names from the CNM into 
color ranges in the Munsell system. All the aforementioned methods are closely related to 
the Munsell model and thus provide explanation on how to locate each name within the 
Munsell color space. However, it is not obvious how to use these methods to 
automatically attach a color name to a color sample, point out examples of named colors, 
describe the color region and objects in a scene, and ultimately communicate the color 
composition of the image. 

One approach to these problems discloses a process for creating a color name dictionary 
and for querying an unage by color name. The steps of Ihe disclosed process are to 
identify a preferred color space, which is then divided into a plurality of color space 
segments, and a color name is assigned to each of the plurality of color segments. In 
accordance with this invention, a color name dictionary defines a set of the color names 
and color name boundaries, advantageously in a three-dimensional visually uniform color 
space. Each color name is rq)resented by a volume in tiie color ^ace. Given an input 
pixel, the color name is assigned using a disclosed method, which identifies the volume 
that includes the color value of the input pixel. However, many psychophysical 
expeaimMits, , have demonstrated that the humans perform much better in picking tiie 
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"best example" for each of the color terms than in estabUshing the boundaries between 
the color names or color categories, and most importantly, that prototypical colors play a 
crucial role in internal representation of color categories, as the membership in color 
categories seem to be represented relative to the proto^e. 

The aforementioned approach also provides a method for querying image by color name. 
The steps of the disclosed process involve direct application of the color naming method 
to individual image pixels and computing the fractional count for each color name from 
the dictionary. To allow for more specific descriptions, the unage is divided into a fixed 
set of regions defined by the unage region dictionary (center, bottom, bottom left, etc.), 
the fractional comts are also computed for each region, and that representation is used to 
answer queries such as "Which of images in the database have most of color name red in 
top-right region". However, this representation is not in agreement with the way humans 
perceive unages and describe their color composition. Humans do not perceive image 
content as bemg m top or bottom right portion of the image - they perform logical 
analysis (image segmentation) and extract meaningfiil regions and objects from that 
image. Humans then describe these objects with a smgle color, e.g. "sky is blue", not by 
the fractional count of the color names occurring withm. Furthermore, it is well known 
that although digital images may include millions of colors, only a very small number of 
these are is actually perceived. Therefore, the direct representation of the color name 
histogram does not match the representation generated by the human visual system. 

A computational model that is better matched to human behavior in naming individual 
colors has been proposed in this method uses color naming data and applies a variant of 
the Gaussian normal distribution as a category model. However, this method is 
constramed to the lowest level of color naming, as it was fitted to the eleven basic color 
names. For example, although it allows for the mtermediate hues, such as greenish 
yellow, the model does not account for commonly used saturation or luminance 
modifiers, such as vivid orange or Ught blue. Since the quaUty of color categorization 
depends on the mtricate fitting procedure, there is no straightforward extension of the 
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model to include these attributes and the model cannot be used with other sets of color 
names. 

As may be appreciated, due to the shortcomings of the existing methodologies, there is a 
long-felt and unfulfilled need for a broader computational color naming method that will 
provide more detailed color descriptions and allow for the higher-level color 
communication to: automatically attach a color name to a color sample, pomt out 
examples of named colors, describe the color region and objects in a scene, and 
ultimately communicate the overall color composition of an image. 



SUMMARY OF THE INVENTION: 

The foregoing problems are overcome, and other advantages are realized, in accordance 
with the presently described embodiments and their teachings. Thus, an aspect of this 
invention is to provide methods, apparatus and systems for automatic color naming, 
color categorization, and for tide automatic derivation of color composition in images. 
These apply to individual color values to automatically determine a color name for a 
given color value. The method also applies to digitaUy represented images, to: 1) 
automatically attach a color name to each pixel in the image, 2) automatically attach a 
color name to the regions and objects in the image, 3) point out examples of named colors 
within the image, 4) generate the verbal description of color composition, 5) replace 
objects and regions with the named color, with the different color, also specified by its 
name. 

Another aspect is to apply, the term color value to any representation used to specify or 
describe colors in an unambiguous manner. Example embodiments include, but are 
not limited to (r, g, b). (L, a, b), (x, y, z). (h, s. v) vectors, when color is specified in 
the RGB, Lab, XYZ and HSV color spaces, respectively. The provided methods are 
generaUy based on the vocabulary of color names and color naming metric derived from 
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perceptual experiments. The method follows relevant studies on human categorization, 
and, captures human behavior in describing mdividual colors and color composition of 
complex images (an image that contains multiple objects, patterns, edges, or colors). 
There are numerous interesting applications for color naming in ims^e processing, 
analysis and computer vision. To start with, using color names to label regions can often 
provide meaningful unage segmentation, since the neighboring regions that share the 
same color name are very likely to belong to the same object. When combined with image 
segmentation, color naming can be used to select objects by color, describe the 
appearance of the image and even generate semantic aimotations, since in many cases 
color names only, or in combination with other imiage features (such as spatial attributes, 
boundary and size features), provide valuable information about images and reveal then: 
semantic meaning. For example, regions labeled as light blue and strong green may 
represent sky and grass, vivid colors are typically found in man-made objects, while 
modifiers such as brownish, grayish and dark convey the impression of the atmosphere in 
the scene. 

The techniques and apparatus described here possesses several desirable properties. First, 
color naming operation is performed in a perceptually controlled way, so that the names 
attached to different colors reflect perceived color differences among them. Segmenting 
the color space into the color categories produces smooth regions. The methods account 
for the basic color terms and uses systematic syntax to combine them. It respects the 
graded nature of category membership, the universality of color foci, and produces results 
in agreement with human judgments. The first step in the method for determining the 
color name for an arbitrary input color this method, involves the selection of a balanced 
and well-represented set of color prototypes, i.e. vocabulary, and the corresponding color 
naming syntax. Color categorization is then carried through the color naming metric. 
Assuming a well-represented set of color name prototypes, tiie metric computes the 
distance between the input color and all the prototypes firom the vocabulary. The 
"optimal" color name for the input color value is then assigned by taking the color name 
prototype, which corresponds to the minimum value of the color naming metric. The 
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color naming metric is designed to overcome the limitations of existing color distance 
functions (such as Euclidean distance in a selected color space), and most importantly to 
accomit for the way humans perceive differences in the color-name domain. 

Also described is a method for attaching the color name to each meaningful region in a 
digital image. According to this method, digital image is first subjected to the chromatic 
transformation to compensate for the differences in illumination conditions, with respect 
to both intensity and spectral characteristics, hi the next step image pixels are subjected to 
labeling procedure. In one, but not limiting embodiment, each pixel is labeled imiform, 
texture, color edge, texture edge or noise. These labels drive the adaptive low-pass 
filtering operation that accounts for the spatial averaging processes in the early stages of 
the human visual system. The smoothed image is then subjected to color segmentation. 
This operation produces a simplified version of the image, i.e. a version which resembles 
the way humans interpret color information. The mean color value for each region firom 
the color segmentation is then mapped into the corresponding color name, using the 
previously described method. The technique described also allows the user to provide an 
example color name, and then inspects the color name attached to image regions to find 
the occurrences of the specified color name in the input image. The method is not limited 
to digital images or collections of digital images (such as digital photographs, digital 
artwork, output of scanning devices, etc.), it also applies to video, multimedia, or any 
representation that involves the spatial arrangement of color values. A simplified 
representation of a scene is a representation that reduced only to the objects and regions 
that are perceived^processed by a human observer. 

Also described is a method for deriving a verbal description, a description that can 
verbalized, for describing the color composition of a digital image. To extract color 
composition, the method starts firom the color-segmented image, and using the color 
naming metric attaches the color name to all perceptually important pixels. In the next 
step, the histogram of color names is computed and used to generate the description of 
color composition. The structure and syntax of the designed vocabulary of color names, 
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allow for descriptions at different accuracy levels that simulate different color nanaing 
patterns in humans. In the present, but not limited embodiment, at the fundamental level, 
the color names are expressed as <generic hue> (such as "red" or "blue") or <generic 
achromatic term> ("gray", "black", "white") from the syntax. At the coarse level, color 
names are expressed as <luminance> <generic hue>, (e.g. "light blue") or <luminance> 
<generic achromatic term> (e.g. "dark gray**)- At the medium level, color names are 
obtained by adding the <saturation> to the coarse descriptions (e.g. "vivid light blue"). 
Finally, at the detailed level, the <hue modifier> is added (e.g. "light vivid greenish 
blue"). 



BRIEF DESCRIPTION OF THE DRAWINGS: 



The foregoing and other aspects of these teachings are made more evident in the 
following detailed description of the invention, when read in conjunction with the 
attached drawing figures, wherein: 



Fig. 1 is a simplified block diagram of a data processing system that is suitable for 
practicing this invention; 



Figs. 2A-2K illustrates an example embodiment of a color naming vocabxdary; 

Fig. 2L illustrates an example of an embodiment of a color naming syntax; 

Fig. 3 is a logic flow diagram that illustrates a method for computing a similarity metric 
between an arbitrary color value cx and a color name prototype cp; 



Fig. 4 is a lo^c flow diagram that illustrates a method for attaching a color name to a 
color sample cx; 
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Fig. 5 is a logic flow diagram that illustrates an example implementation of a method for 
computing a similarity metric between a color value cx and a color name prototype cp; 

Fig. 6 is a diagram illustrating an example embodiment of the method for computing the 
color name distance between an input color cx, and a prototype color from the vocabulary 
cp (i.e. the computation of the color naming metric); 

Fig, 7a shows an application of a color naming method to name different color regions for 
color names assigned to the "color circle" in the HSL space defined with s = 83 and 
1=135; 

Fig. 7b shows an application of a color naming method to name different color regions 
for transition of color names along the black-red, red-yellow, purple- white, and 
black-green lines in the RGB space; 

Fig. 8 is a logic flow diagram that illustrates an image smoothing algorithm and detection 
of important regions and objects in an image. 

Fig. 9 is a logic flow diagram that illustrates an example implementation of the image 
smoothing algorithm, followed by the detection of important regions and objects in the 
image; 

Fig. 10 is a logic flow diagram that illustrates a method for attaching a color name to the 
regions and objects in the image; 

Fig. 1 1 is an example result of image smoothing, region detection, and attaching the color 
names to the important regions and objects in the image; 



Fig. 12a is a logic flow diagram that illustrates a method for pointing out examples of 
selected color in the image; 
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Fig. 12b is a logic flow diagram that illustrates a method for replacing a selected color 
wifli a different color; 

Fig. 13 illustrates an example embodiment of the rules that describe different accuracy 
levels in expressing the color composition of an image; 

Fig. 14 is a logic flow diagram that illustrates a method for the computation of the 
description of the image color composition; 

Fig. IS is an example of the result of the computation of color composition; and 
Fig. 16 is illustrates some possible applications of the color naming methods. 

DETAILED DESCRIPTION OF THE INVENTION 

This invention provides image processing methods, apparatus and systems that are 
generally based on human perception, which: a) attaches a color name to an input color 
sample, b) describes objects and regions in an image with their color names, and c) 
generates the verbal description of image color composition. The methods are used in 
many image processing, computer vision, graphics and visualization applications. The 
methods enable development of better user interfaces and better man-machine 
interaction. The methods are implemented using a set of image processing algorithms, 
that analyze the input color value to determine optimal color name from ihe vocabulary of 
color names, and then process the image to break it into meaningful regions, determine 
the perceived color value of these regions and attach the color names appropriately. 

A first example of a method automatically assigns a color name to an input color value, or 
color sample, without requiring the use of a labor-intensive process where each color 
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sample is labeled manually with the coiresponding color name. A second example 
method, provides an algorithm to automatically label regions and objects in an image 
with the best describing color names and then generates the verbal description of the 
overall color composition. These are advantageous in image analysis, in applications 
dealing with multimedia databases, as well as in the fields of artificial intelligence, 
visualization, computer graphics, user-interface design and human-machine mteraction. 
As used herein, a scene is consistent with human observation of the scene is consistent in 
a sense that all the important objects, regions and edges are preserved in the simplified 
representation, as well as all the colors that the human observer perceives. 



Figure 1 is a simplified block diagram of an example of an embodiment of a data 
processing system, 100 that is suitable for practicing the invention, as well as the 
teachings of the present invention. The data processing system 100 includes at least one 
data processor 101 coupled to a bus 102 through which the data processor 101 may 
address a memory subsystem 103, also referred to herein simply as the memory 103. The 
memory 103 may include RAM, ROM, and fixed or removable storage devices. The 
memory 103 is assumed to store a program with the program instructions for caxising the 
data processor 101 to execute methods in accordance with the teachings of the invention. 
Also stored in the memory 103 is at least one database including data representing a 
vocabulary of color names or pointers to externally stored vocabulary data. Also stored in 
the memory 103 is a set of color values (or references to extemally stored color values), 
and/or digital image data (or references to extemally stored digital image data), and the 
resulting color naming data (i.e. data obtained by applying the teachings of the invention). 
The color values may include any color representation used to unambiguously specify 
color, such as three-element vector specification in the RGB, XYZ, HSV, Lab, Luv, or 
any other system which may be used to specify colors. The color values may be entered 
into the memory 103, through any input device (such as keyboard, microphone, 
colorimetric device, etc.), also they may be obtained through the mean of digital camera, 
scanner, or by use of any pointing device that selects or produces a certain color, such as 
mouse, pen, etc. The color values may also be obtained by reading the color information 
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from digital images, by means of speech or character recognition, web pages, 3D models, 
simulation results, etc. The digital image data represents any spatial arrangement of color 
values. This may include photographs obtained from a digital camera, or any device that 
outputs digital images (such as camcorder, electronic microscope, telescope, medical 
imaging device, etc.), images obtained from a conventional film camera and scanned or 
digitized into the memory 103, computer generated images, or artworks that are 
photographed and scanned or digitized into the memory. In general digital image data 
may be any desired type or types of images, including digitally stored artworks, designs, 
paintings, forms, web page layouts, medical images, movie shots, screens and shots from 
video games, etc. 



In some embodiments, the data processor 101 is coupled through the bus 102 to a 
network interface 106 that provides bidirectional access to a data communication network 
107, such as intranet and/or internet Coupled to the network 107 can be on or more 
sources and/repositories of external data, such as a remote digital image database 108, or . 
remote database of color samples and/or color values 109, reachable through an 
associated server 110. The data processor 101 is also advantageously coupled through the 
bus 102, or the network 107, to at least one peripheral device 111, such as scanner 1 1 1 A, 
printer 1 1 IB, digital camera 1 1 IC, medical imaging device 1 1 ID, microphone 1 1 IE, etc. 

In general these teachings may be implemented using one or more software programs 
running on a personal computer, a server, a mainframe computer, a portable computer, 
PDA, an embedded computer, or by any suitable type of programmable data processor. 
The use of this invention substantially improves analysis, description, annotation and 
other information processing tasks related to digital images and digital color data. It also 
substantially improves human-machine interaction and user interface design. The 
teachings of this invention can also be configured to provide real-time processing of 
color-related and/or image-related information. The methods may be used to process the 
color data and/or digital image data stored in or referenced by the database 104 or in a 
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remotely stored databases 108, 109 over the network 107 and in cooperation with the 
server 110. 



The foregoing system and methods provide for verbally (i.e. through color names) 
describing individual colors specified by their color values, colors of object in digital 
images, as well as for generating the description of the overall color composition, based 
on the syntax and vocabulary of color names, and the color naming metric. The 
vocabulary, syntax and the metric are derived advantageously from perceptual 
experiments performed with human observers. 



Figures 2A-2K illustrate an example embodiment of a vocabulary of color names, and 
Figure 2b illustrates an example, but not limited embodiment of a color naming syntax. 
Each entry in the vocabulary represents a color name prototype, specified by: 1) its color 
name, which follows the formal syntax of the color naming language, and 2) its color 
value in an arbitrary color space. Advantageously, the color value for each of the color 
name prototypes should represent the centroid of a region (in a perceptually uniform color 
space) that is described by the corresponding color name. 

A set of experiments was conducted to: 1) understand human behavior in describing and 
naming individual colors, 2) xmderstand human behavior in naming colors within 
complex scenes, (, 3) xmderstanding human behavior describing color composition of 
images, and 4) determine the reliable and general set of color names to be used as the 
color name vocabulary. As used herein, the term general set of color names refers to a set 
of color names that is widely and fi^equently used in everyday life, is understood by the 
general public, and can most generally fixlly describe appearance of any object, scene, 
etc.). Ten subjects participated in the experiments. The vocabulary of color names used in 
an embodiment, of the invention, was developed starting from the set of color names 
described by K. Kelly, and D. Judd. Through the set of subjective experiments, the names 
of colors from the ISCC-NBS dictionary were changed to reflect human judgments in 
color naming. In these experiments (called Color Naming Experiments) known to those 
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familiar with the art, the subjects were presented with the colors from the ISCC-NBS 
color dictionary, and asked to name each one of them. The color patches were displayed 
on the computer monitor. 



In the first experiment, 64x64 pixel patches were arranged into 9x6 matrix and displayed 
against light gray background. The names were assigned by typing into a text box below 
each patch. After naming all the colors, the display was updated with the new set of 
patches, until all 267 colors from the dictionary have been named. 

In the second color naming experiment, only one 200x200 pixels color patch was 
displayed on the screen. To analyze the agreement between these two color nanaing 
experiment, for each experiment a list of corrected color names was made, i.e. the names 
from the ISCC-NBS vocabulary were changed to reflect the opinion of the majority of 
subjects. The two lists showed very good agreement between the experiments. The final 
vocabulary is determined as the list from the first color naming experiment, since the 
names were generated in tiie interaction with other colors, which is seen as a better 
representation of real-life applications. 

The two Color Naming Experiments were also usefiil for studying the patterns in hxmaan 
color naming behavior. For example, the most noticeable difference between the two 
color naming experiments was in the use of luminance modifiers. The same color was 
often perceived brighter when displayed in a small patch (Experiment 1) than in a large 
window (Experiment 2). Also, very pale and unsaturated (grayish) colors appeared more 
chromatic when displayed in a smaller window. To better understand the human behavior 
in color naming, two more subjective e>q)eriments were performed. In the first 
experiment, called Color Listing Experiment, subjects were asked to write on a sheet of 
paper names of at least twelve "most important" colors. In the second experiment, called 
Color Composition Experiment, the subjects were presented with 40 photographic images 
in a sequence and asked to name all the colors in the image. The images were selected to 
include different color compositions, spatial frequencies and arrangements among the 
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colors, and provide broad content. The subjects were advised to nse common color terms, 
as much as possible, to avoid rare color names, and color names derived from objects and 
materials. If they found a certain color difficult to name, they were advised to describe it 
in terms of other colors. 



In the Color Listing Experiment 1 1 basic colors from B. Berlin and P. Kay, "Basic Color 
Terms: Their Universality and Evolution", Berkeley: University of California, 1969, were 
found on the list of every subject. Nine subjects included beige, four mcluded violet, two 
included cyan and magenta, and one included gold and silver. Modifiers for hue, 
saturation and limiinance were not used. None of the subjects listed more than 14 color 
names. The subjects maintained the same limited vocabulary when describing images in 
the Color Composition Experiment, and added only beige to the basic colors. The 
modifiers for hue, saturation and luminance were used only to distinguish between the 
different types of the same hue in the single image (such as light blue for sky and dark 
blue for water, or orange yellow and vivid yellow for two different objects). Otherwise, 
the modifiers were seldom included into description. It was also observed that the 
subjects were more prone to attaching the modifiers for lun^nance than the modifiers for 
saturation. 



Although most of the experimental images had rich color histograms, the subjects were 
not able to perceive more than ten colors at once. Dark colors, which typically exist in 
natural images due to shadows and edges, or bright colors due to highlights and 
specidarities, were never included in the description, and were named only when referring 
to well-defined objects/regions. The subjects showed the highest level of precision in the 
Color Naming Experiments, Most of them (8/10) frequently used modifiers for hue, 
saturation or brightness. The modifiers for hue were designed either by joining two 
generic hues with a hyphen, or by attaching the suffix -ish to the ferther hue, and leaving 
the closer hue unchanged. Typically, only two adjacent hues (such as purple and blue, or 
green and yellow) were combined. 
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The findings firom all four experiments were used to devise the vocabulary depicted in 
Figure 2a. The terms for brightness are determined to be: blackish, very dark, dark, 
medium, light, very light and whitish. The terms for saturation are determined to be: 
vivid, strong, medium, moderate, grayish. The complete set of generic hues is determined 
to be: red, green, yellow, blue, orange, pink, purple, brown, beige and olive, with the 
addition of achromatic names black, white and gray. These findings were expressed in 
the formal syntax, as illustrated in Figure 2b. 

Having established the vocabulary of color names, in accordance with an aspect of these 
teachings, the next step is to develop an algorithm for attaching the color name to an 
arbitrary input color. To address the graded nature of category membership and take into 
account tiie universality of color foci, the color categorization should be performed 
through the color naming metric. Assuming a well-represented set of prototypes (foci), 
the metric computes the distance between the input color and all the prototypes, thus 
quantifying the difference between the input color and each color name prototype. 

By way of introduction. Figure 3 shows a logic flow diagram that illustrates an example 
of a method for computing a similarity metric between a color value (color sample) cx 
and a color name prototype cp. The method is assumed to be executed by the data 
processor 101 imder control of a program or program stored in the memory 103. This 
implementation is based on the finding that the colors that share the same distance (in 
arbitrary color space) to a color prototype cp, may not be perceived as equally similar to 
that prototype, in which case the color distance has to be updated proportionally to the 
amount of dissimilarity. The computation of the color metric between an arbitrary input 
color cx and the prototype cp, is then based on: a) computing the distance between cx and 
cp (step 301), b) finding the optimal color match to cp for the given distance (step 302), 
c) estimating the perceptual difference between cx and the optimal color match (step 
303), and d) using this esthnate to modify the distance between cx and cp (step 304). 
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Figure 4 is a logic flow diagram that illustrates an example of a method for attaching a 
color name to the input color ex. Step 401 loads a vocabulary of color names, i.e. a set of 
color prototypes. Step 402 gets the input color value ex. At step 403, the data processing 
system compares the color value cx to the color value of each color name prototype from 
the vocabulary of color names 405, via the color naming metric. At step 404, the data 
processing system determines the minimum of the color naming metric and attaches the 
corresponding color name to the input color value cx. It should be understood that the 
present invention enables multiple vocabularies of color names 405 to be defined, such 
as, with a different vocabulary 405 specific for a different task or application. 

By way of introduction. Figure 5 is a logic flow diagram that illustrates an 
implementation of an example of a method for computing a similarity metric between a 
color value (color sample) cx and a color name prototype cp. The method is generally 
executed by the data processor 101 under control of a program or program stored in the 
memory 103. At step 501 the input color values are transformed into Lab and HLS 
coordinates. At step 502 the data processing system computes the optimal perceptual 
match to the prototype cp, for the given Lab distance. At step 505, the data processing 
system estimates tiie difference between the optimal perceptual match and the input color 
cx, and at step 506, the data processmg system uses that estimate to modify the Lab 
distance between cx and cp. 

An advantageous embodiment is based on the experimental finding that, although 
commonly used as measure of color similarity, Euclidean distance in the CIE Lab color 
space has several serious drawbacks for the use as a color naming metric. A first problem 
is related to the sparse sampling of the color space. Since the uniformity of the Lab 
suffers from defects its "nice" perceptual properties remain in effect only within a radius 
of few just-noticeable differences. Since the vocabulary of color names typically has a 
small number of color names, the distances between the colors may he large and the 
Euclidean metric only partially reflects the degree of color similarity. The other, more 
serious problem is related to human perception of color names and their similarity. 
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Assuming an arbitrary color represented by a point q) in the Lab space, and a set of 

neighboring colors cni, i = 1,...,N on a circle with the radius L in that space, although all 

the pairs (cp, cni) are equally distant, humans do not parceive them as equally similar. 

To test the relationship between perceptual sunilarity, and color distances in different 
color spaces, a subjective experiment was conducted. Four subjects participated m the 
experiment. The subjects were given ten sets of color samples. Each set consisted of a 
^'prototype" color cp and five colors, cni, i = 1,...,5 so that DLab(cp, cni) = const. The 
distances between the prototype and the rest of the colors ranged from 6 to 30. For each 
set the subjects were asked to order the samples.according to the perceived smiilarity to 
the set prototype. These sets were displayed in sequence on a computer monitor with light 
gray background under the daylight illumination. Each color sample was displayed in the 
100x100 pixels window and could be moved on the screen to allow for the comparison 
with the prototype cp. 

For all the pairs, the color distances, and angles between the color vectors were computed 
in both Lab and HSL spaces. These measurements were analyzed and also correlated with 
the subject's rankmgs. The first thing that was observed is that for Dtab < 7 all the colors 
were perceived as equally similar to the prototype, hi most of the other cases subjects 
identified the best and worst match unanimously, frequently leavmg other samples 
unranked. Typically, the colors subjects failed to rank were close in all three values. For 
the colors that were ranked by the subjects, the correlation between the subjects' rankings 
and rankings determined based on angle in the HSL space was 0.96. The correlation 
between the subjects' rankings and rankings determmed based on the distance in the HSL 
space was 0.85, and the correlation with the rankings determined based on the angle in 
the Lab space was only 0.70. The slope of the least square regression line for the subjects' 
rankings and the rankings assigned according to the angle in the HSL space was 0.97. The 
slope of the least square regression line for the subjects' rankings and the rankmgs 
assigned accordmg to the distance in the HSL space was 0.84, and the slope of the least 
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square regression line for the subjects' rankings and the rankings assigned according to 
the angle in the Lab space was 0.87. These results indicate that the color angle in the HSL 
space and the color distance in the HSL space (alone or conabined) may be used as 
predictors of perceptual similarity between the equidistant colors, although none of these 
two values alone represents an accurate color naming metric. 

The color naming metric is then designed to embody the findings firom the experiment. It 
models the behavior of subjects in color categorization. Assummg a prototype cp and 
arbitrary input color cx, as discussed previously, for a given Diat(Pp,c^) , the combination 

between QHsiicp^Cy,) and D^sLicp^cx) reflects the "reliability" or "goodness" of the Lab 

distance as the measure of shnilarity in the color name domain. Thus, this relationship is 
used to modify ^lab in the following manner. First, the distances between Cp and in 

the Lab and HSL color spaces is computed as: 



DHLS{Cp,Cx) = /? = ^s} + 5i - ISpSx COS{/lp - hx) + (/p - 

In the next step, given the radius R, the data processing system finds the color 



Co : iho,so,lo) , so that: DHLs(cp,c.) = R , and eKSL(cp,c„) = , J' - ° • 



Solving (1) results in: lh=f>p, Soi.2 =Spil±R/^isl+l^)} , i„i^2 =lpQ±R/^(.sl+lj)) , and 
the final solution is obtained by taking a point that is satisfied. 
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This procedure is iUustrated in Figure 6. According to the experimental results, given the 
distance L, the optimal perceptual match corresponds to the direction = 0 . 

Assuming a small increment A/J, the mitial solution co is then updated in the following 
manner: Ro^D„sL{cp,Co), s„ = *o(l±A/?/i?a) . and /« =/oO±A/?/ until Du.i>icp.c„)^ D , 
At this point, co represents an optimal perceptual match to , for the given Lab distance. 
This solution is therefore denoted copt . An estimate of perceptual dissimilarity between 

cx and c^t is then computed as a relative difference in the HSL space between Copt , and 

the projection cx -Lcopi ' 

diCp,Copt)-diCp,c„^) _ -iicosa ^ SpS^ cos(/»p -hx)+lplx -^p '^p 
^^'P''^'^- dicp,c,p,-) Ro Roff^ 

As used by the model in predicting the amount of perceptual similarity, this formula takes 
into account both the distance and the angle in the HSL space. Therefore, this value is 
used to modify the Lab distance between the colors Cp and c, in the following manner: 

DiCp,Cx)^Diab(.Cp.Cx)+KDLabi<:p,Cx))Diab(.Cp,CxWicp,Cx) 

i.e. the Lab distance is increased proportionally to the amount of dissimilarity M . The 
fector is introduced to avoid modifying distances between very close points, so that 

k(L) = 0 if L < 7, and to limit the amount of increase for large L, i.e. k(L) = const, if 
L > 30. Figs. 7a and 7b show appUcations of a metric used to name different color regions 
in the RGB and HSV color spaces. Figure 7a shows the color names assigned to the 
"color circle" in the HSL space defmed with s = 83 and 1 = 135. Figure 7b shows the 
transition of color names along the black-red (0 < r < 255, g = 20, b = 20), red-yellow 
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(r = 235,0<g<255,b = 20),purple-white(0<r<255,g = 0,0<b<255),and 
black-green lines (r = 20, 0 < g < 255, b = 20) in the RGB space. 

This approach is now expanded and applied to automatically attach color names to 
regions and objects in digital images, and to derive a verbal description of the color 
composition in images. This embodiment, is based at least in part on the fact that the 
hxmian observation of a. scene is typically very different from the recorded image. When 
describing the color composition of a complex scene (a scene that includes multiple 
objects, patterns, edges, or colors) human perception aims at constructing a visual 
representation with *^dvid colors" and details across a wide range of lighting conditions. 
As a matter a fact, the very notion of a "color name" has its roots in the fact that humans 
perceive and interpret color information independently of the light source - the 
phenomenon known as color constancy. On the other hand, the teachings of this invention 
presented so far, generally only allow for naming isolated samples of colors, or attaching 
color names to individual image pixels; the teachings do not accoxmt for color constancy, 
or the spatial relationships and interactions among the colors. 

An embodiment of a method that takes into account the issues listed above and aims to 
provide a description of the scene consistent with human observation is now described. 
The algoritinn has two parts. The first part deals with the problem of color constancy, 
while the second one provides image smoothing and segmentation suitable for the 
extraction of perceived colors. 

Figure 8 is a logic flow diagram that illustrates an example of a method for constructing 
the image representation that resembles the human observation of a scene and its color 
content. This method is designed to simulate the processes conducted in the early stages 
of the human visual system, which performs significant amount of spatial averaging. At 
step 801, the input image is subjected to a chromatic adaptation transform, to eliminate 
the differences caused by different illvimination conditions. Step 802 performs edge 
detection. Usmg the edge information, step 803 performs pixel labeling to distmguish 
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between different types of pixels (e.g. Tiniform pixels, texture, region boundaries, noise, 
etc.). In step 804 the image is adaptively smoothed, where the amount of smoothing is 
determined based on pixel labels. In step 805, the image is subjected to image 
segmentation to detect important regions and objects in the image. All the steps are 
conducted by the data processor 101 under the control of a program or program stored in 
the memory 103. 

More specifically, the first step (801) in the described inethod uses an application of a 
chromatic adaptation transform, that will compensate for the differences in illumination 
conditions, with respect to both intensity and spectral characteristics. The present 
embodiment, utilizes the Von Kries algorithm known to those skilled in the art, to 
accomplish this task. However it should be noted that experiments have demonstrated 
that any procedure that stretches the gray axis of the original image and realigns it with 
the theoretical gray axis for perfectly homogeneous flat-spectrum illumination, performs 
well in the given problem. 



The following steps (802-805) in the method perform spatial averaging and image 
segmentation that simulate the way humans perceive the color content of images. More 
specifically, in its early stages the human visual system performs significant amount of 
spatial averaging, which accounts for the way humans interpret color information. The 
smoothing process is partly due to the nature of the channel between the retina and the 
visual cortex, where the neighboring receptors converge into one ganglion, while the 
groups of ganglions converge to single neurons in tiie visual cortex. However, the 
amount of averaging depends on the spatial firequencies, spatial relationships among 
colors, size of the observed objects and the global context. For example, it is well known 
that the capability of the human visual system to distinguish different colors drops rapidly 
for high spatial firequencies. Consequently, htmaans describe textured areas with a single 
color, since only spatial averages of the microvariations are perceived. On the other hand, 
the human visual system does not average isolated edges, as they represent object and 
region boundaries. Based on these observations, the smoothing and segmentation are 
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carried out by modeling hximan perception as an adaptive low-pass filter operation, i.e. 
convolution of the input image with a localized kemel. 



Figure 9 shows a logic flow diagram that illustrates an example of an implementation of 
the image smoothing algorithm, followed by the detection of important regions and 
objects in the image. The method is assumed to be executed by the data processor 101 
xmder control of a program or program stored in the memory 1 03 . In step 901 , the input 
image is processed according to the Von Kries transform to eliminate differences in the 
illumination conditions. Step 902, computes the amount of local contrast for each pixel in 
the image. In step 903 these values are used to determine if picture represents an edge. 
Step 904 computes the mean and variance of edge density in a neighborhood of each 
image pixel. In step 905, the means and variances are used to label pixels into different 
pixel types (e.g. noise, uniform, color edge, texture edge, coarse texture, fine texture). In 
step 906, pixel labels are used to control the amount of Gaussian smoothing. In step 907, 
the smoothed image is subjected to color segmentation. 

With even more details, an embodiment of this method, may start by reducing the nimiber 
of colors in the image via use of, for example, the LBG vector quantization algorithm. 
The result of color quantization represents a set of colors that optimally represent image 
colors in the Lab space. The next step is to compute the local color contrast, con(x,y), for 
each image pfacel (x, y) and use it to determine if the pbcel represent an edge (e.g. the 

pixel is considered an edge if its contrast exceeds a predefined threshold conmm). In the 
next step, to distinguish between the uniform regions, texture areas, and contour points, a 
sliding window is used to estimate the mean m, and variance v, of edge density for each 
pixel. Depending on these estimates the pixels are labeled as: type 1) uniform, m = 0, 
TYPE 2) noise, m < tmi, type 3) color edge, i.e. edge between two uniform regions, 
tmi < m < tm2s type 4) tcxturc edge, i.e. transition between uniform and textured region (or 
between two textured regions), tm2 < m < t^, type 5) coarse texture, m > t^s, v > tv , or type 
6) fine texture, m > t^a, v < tv . The labeling operation produces pixel maps, which control 
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the smoothing process and determine the computation of dominant colors in the 
following way. The pixels labeled as noise are first removed, i.e. their color is changed 
into the surrounding uniform color. Since the human eye creates a perception of a single 
dominant color within uniform regions, the amount of smoothing is largest for the 
imiform pixels. To allow for the highest amoimt of smoothing, flie radius of the 
smoothing kemel is chosen adaptively for each uniform pixel, depending on the distance 
to the closest edge (color or texture). Pixels labeled as color edge (type 3) and texture 
edge (type 4) are not filtered. Also, since edges do not contribute to the way humans 
describe color content, these pixels are not used in the computation of color composition. 
Finally, the amoimt of averaging performed in textured areas is chosen based on the edge 
density, so that the amount of averaging is higher for fine textures and lower for coarse 
textures. Thus, the perceived color at the location (x,y) , pcix.y) , is computed as: 

P<Kx,y) = (c*gy^j^ ,y))(x,;v), where Sj^^x^^y^)^x,y) is the Gaussian kemel defined as: 

and ^i^>y) is the radius of the kernel, which depends on the type of pixel in the center of 
the kemel, , as: 



\\ix,y)-ix^,y^)\l uniform region, i.e. (x^,;;^) is Type 1 
D, coarse texture, i.e. (jc^,y^) is Type 5 

2D, fine texture, i.e. (x^ , ^ ^ ^^P® ^ 



and (xe.ye) is the edge pixel closest to ix,y) . As given by these formulas the smoothing 

algorithm averages only within imiform and textured regions, thxis simulating the 
behavior of the human visual system. However, in reality, due to imperfections in 
computing the edge maps, all the boundary pixels caimot be entirely excluded from the 
smoothing operation. This produces some "graying out" of the resulting image, either 
globally or in the specific regions. The desaturation of color may cause some regions to 



wo 2004/027695 PCTAJS2002/029974 

27 

be perceived and consequently named quite differently, and there may be a need to. 
consider some color-restoration scheme. Since the main goal is to preserve the same 
appearance of colors to the human observer as the original image, the color-restoration 
problem can be viewed as the color-constancy problem. Therefore, a chromatic 
adaptation transform in the linear color space, may be applied again to stretch the gray 
axis and minimize the color distortions introduced by averaging across different regions. 

In the next step, the smoothed and "color-restored" image is subjected to color 
segmentation and used as an input to the color naming procedure. For image 
segmentation, one uses a color-based segmentation algorithm known to those skilled in 
the art,. Prior to the segmentation the color value for each pixel labeled as color edge or 
texture edge is replaced v^th the color value of the closest uniform or texture region. The 
resulting image is then used in conjvmction with the color naming method to perform 
different color naming tasks in images. 



Figure 10 shows a logic flow diagram that illustrates an example of a method for 
attaching a color name to the regions and objects in the image. The method is assumed to 
be executed by the data processor 101 under control of a program or program stored in 
the memory 103. At step 1001, the input image is subjected to image smoothing and 
segmentation. At step 1002 the data processing system computes perceived color for each 
region and each object identified by the step 1001 . At step 1003, the data processing 
system 101 uses the color naming metric to compute the color name for each image 
region, using its perceived color value as the input into the color naming algorithm. In 
this embodiment, the perceived color value of the image region is computed by averaging 
the color values of all perceptually important pixels from that region. Pixel color values 
are advantageously specified in a linear color space. In current, but not litnited 
implementation of the method, all pixels labeled uniform, coarse texture and fine texture 
are considered perceptually important, while pixels labeled noise, color edge, and texture 
edge are not used in computation. 
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Figure 1 1 shows an example of the result of image smoothing, region detection, and 
attaching the color names to the important regions and objects in the image. Figure 1 1 
shows: (A) an original input image , (B) image after the chromatic adaptation transform, 
(C) pixel map with pixels identified as uniform (white pixels), (D) pixel map with color 
and texture edges (white pixels), (E) pixel map with pixels identified as texture (white 
pixels), (F) image obtained as a result of adaptive smoothing, (G) image obtained as a 
result of color segmentation, and (H) image with color names attaches to all important 
regions. 



Figure 12a shows a logic flow diagram that illiistrates an example of a method for 
pointing out examples of selected color in the image. The method is assumed to be 
executed by the data processor 101 under control of a program or program stored in the 
memory 103. At step 1201, the input image is subjected to image smoothing and 
segmentation. At step 1202 the data processing system computes the perceived color for 
each region and each object identified by the step 1201 . At step 1203, the data processing 
system 101 uses the color naming metric to compute the color name for each image 
region, based on its perceived color value. At step 1204, using the GUI 104 and 1 05, the 
user specifies and example color (or colors) ca. At step E, the data processor 101 searches 
all the color names in the input image to find all the occurrences of color name ca. At step 
1205, using the display part of the GUI 104, the data processing system displays to the 
user the search resxilt for the given image. 



Figure 12b shows a logic flow diagram that illustrates a method for replacing a selected 
color with a different color. The method is assumed to be executed by the data processor 
101 under control of a program or program stored in the memory 103. At step 1210, the 
input image is subjected to image smoothing and segmentation. At step 1211 the data 
processor 101 computes the perceived color for each region and each object identified by 
the step 1210. At step 1212, the data processor 101 uses the color nanodng metric to 
compute the color name for each image region, based on its perceived color value. At step 
1213, using the GUI 104 and 105, the user specifies the color (or colors) to be replaced 
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ca, and the replacement color (or colors) cb. At step 1214, the data processor 101 
searches all the color names in the input image to find all the occurrences of color name 
ca. At step 121 5, the data processor 101 replaces all the pixels having color ca, with the 
pixels having color cb. 

An important application of these teachings is for example, in a method for automatically 
generating a verbal description of overall color composition in images. If the color name 
vocabidary and syntax are derived in a perceptual way, to reflect human behavior in color 
categorization, the teachings of this invention allow for describing color composition at 
dififerent accuracy levels. These different precision levels correspond to different color 
naming patterns in himians. For example, people mostly use fundamental level when 
referring to well-known objects, or when color-related information is not considered 
important. According to the described subjective experiments, the descriptions of 
photographic images are mainly formulated with liie coarse or medium precision, while 
the color names at the detailed level are typically used when describing specific objects or 
regions, or emphasizing the difference among them. Specifically: 1) fundamental level 
captures the behavior of our subjects in the Color Listing Experiment, 2) descriptions of 
the photographic images in the Color Composition Experiment were mainly given with 
the coarse or medixrai precision, and 3) color names at the detailed level were used when 
describing isolated color samples (Color Naming Experiments), or specific objects and 
regions (Color Composition Experiment). 

Figure 13 illustrates one example, but not limited embodiment of the rules that describe 
different accuracy levels in expressing tiie color composition of an image. These rules are 
derived based in the fmdings from the previously described subjective experiments. More 
specifically, at the fimdamental level, the color names are expressed as <generic hue> or 
<generic achromatic temi> from the syntax described in Figure 2. At the coarse level, 
color names are expressed as <luminance> <generic hue>, or <luminance> <generic 
achromatic term>. At the medium level, color names are obtained by adding the 
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<saturation> to the coarse descriptions. Finally, at the detailed level, the complete <color 
name> as specified in Figure 2 is iised. 

Figure 14 shows a logic flow diagram that illustrates an example of a method for the 
computation of the verbal description of the color composition of an input image. The 
method is generally executed by the data processor 101 eliminates all the perceptually 
insignificant colors, or remaps them into the closest perceptually important color. In 
current but not limited embodiment of this method, noise pixels, which are not perceived 
by the human visual system, are remaped into the closest uniform color, while the other 
perceptually insignificant pixels (such as region boundaries, and transitions between the 
regions) are eliminates (i.e. these pixels are not considered in the next steps). At step 
1403, tiie data processor 101 computes the color name for each perceptually significant 
image pixel, based on its color value. At step 1404, the data processing system loads a set 
of rules that describe different color naming patterns in humans. At step 1405, the data 
processor 101 computes the histogram of color names for each accuracy level. Figure 15 
shows an example of results of the computation of color composition. 

It should be noted that while the foregoing methods and system can be used to attach 
color names to individual pixels, samples of color, regions and objects in images and to 
derive the description of color composition, they can be used in many other applications 
involving manipulation with color values, color analysis and color naming in image 
processing, video processing, visualization, computer graphics and human-machine 
interaction. To start with, using color names to label regions can often improve the result 
of image segmentation, since the neighboring regions that share the same color name can 
be merged. In many cases color names only, or in combination with other features (such 
as spatial attributes, boundary and size features), can provide valuable information about 
the analyzed images and reveal their semantics. For example, as illustrated in Fig 16a, 
regions labeled vivid blue or vivid purplish blue found in the upper part of the image, 
may represent sky on a bright sunny day. In the same picture regions witii regular 
boundaries/geometry and bright saturated colors are very likely to be man-made objects. 
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Similarly, the flowers shown in Figure 16b can be easily detected based on the 
relationships between the curvature and color of the vivid reddish purple region, and the 
neighboring green regions. Overall color composition, as generated with the teachings of 
this invention, often captures the atmosphere m the scene. For example, by combining the 
linguistic terms firom the color name syntax described in teachings of this invention, the 
scene shown in Figure 15b can be described as "brownish", and easily related to a 
man-made environment. Another example of what can be accomplished by adding the 
color naming ability to the traditional image features (e.g. regions, lines, texture, etc.). By 
mergmg all the descriptors, as shown in Figure 16c, it can be easUy concluded that the 
image is very likely to be an outdoor scene, probably a cityscape or a man-made structure 
seen from the large viewing distance. Assuming the hypothesis is correct, a step further 
would be to conclude "the weather wasn't really nice when the picture was taken". Color 
naming ability may be implemented as a part of Artificial Intelligence Systems. For 
example it is also within a scope of these teachings to manipulate a robot by naming and 
describing the objects it should pick from the production line. In such a case a digital 
unage robot receives would be subjected to the processmg shown in Figure 10, and the 
spatial location of the named color withm the digital image, would be remapped to the 
actual physical location on the production line. 

Thus the present mvention provides a method employmg a vocabulary of color names in 
assigning a color name to a pixel in a digital representation, mcluding the steps of: 
providmg the vocabulary of color names with a plurality of color prototypes, each color 
prototype having a prototype color name and a corresponding prototype color value; 
comparing a pixel color value of the pixel to the prototype color value of each color 
prototype in the vocabulary, and obtaming a color match value for said each color 
prototype in the vocabulary; determining a closest color match value resulting from the 
step of comparing; and assigning to the pixel a particular prototype color name 
corresponding to the closest match value. 
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In some embodiments the method includes fomiing the vocabulary of color names, 
includes the steps of: obtaining at least one general set of essential color names, each 
essential color name having a corresponding color value; whereby each color name 
includes a hue descriptor, brightness modifier, and saturation modifier; and selecting a 
subset of at least one general set in meeting an application desire for the vocabulary of 
color names; and/or acquiring a digital representation of a scene, employing the 
vocabulary in providing a description of a color composition in the scene. 

Thus the present invention provides a method obtaining a vocabulary of color names, 
acquiring a digital representation of a scene, and employing the vocabulary in providing a 
description of a color composition in the scene. 

The aspects of this invention also provides a tool for enriching user interfaces and 
man-machine interaction. For example, a techniques made possible by this invention, 
may allow a web designer to select and manipulate colors for the web page via a voice 
interface and speech recognition system. The same tools apply to many design processes, 
such as interior design, coloring of CAD models, architecture, design of textiles and 
prints, etc. The methods may be included as a part of e-commerce tools, where a user may 
type his search for a "light brown sofe", and in addition to the text search, a database of 
images may be analyzed to find the objects that match the description. 

Therefore, while methods and system have been disclosed for deriving color names of 
individual colors, color samples image pixels, and for describing colors and color 
composition in images, it should be appreciated that these teachings are not to be limited 
to only the presently described embodiments disclosed herein, nor is this invention to be 
limited in any way by the specific examples if color names, color syntax, color naming 
rules and subject matter that were disclosed above. 



Thus it should be apparent that these teachings are clearly not intended to be limited only 
to processing color values and collection of digital images stored in a computer memory 
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devices, or in some form of computer readable media. As such, the various descriptions 
found above should be viewed as being exemplary of the teachings of this invention, as 
these descriptions were provided as an aid in understanding the teachings of this 
invention, and were not intended to be read in a limiting sense upon the scope and 
practice of this invention. 



In some embodiments, the invention is an article of manufacture comprising a computer 
usable medium having computer readable program code means embodied therein for 
causing assignment of a color name, the computer readable program code means in said 
article of manufacture comprising computer readable program code means for causing a 
computer to effect the steps of a method of this invention. In other embodiments, the 
invention is implemented as a program storage device readable by machine, tangibly 
embodying a program of instructions executable by the machine to perform method steps 
for assigning a color name, said method steps comprising the steps of a method of this 
invention. 



The present invention can be realized in hardware, software, or a combination of 
hardware and software. A visualization tool according to the present invention can be 
realized in a centralized fashion in one computer system, or in a distributed fashion where 
different elements are spread across several interconnected computer systems. Any kind 
of computer system - or other apparatus adapted for carrying out the methods and/or 
functions described herein - is suitable. A typical combination of hardware and software 
could be a general pxxqjose computer system with a computer program that, when being 
loaded and executed, controls the computer system such that it carries out the methods 
described herein. The present invention can 2ilso be embedded in a computer program 
product, which comprises all the features enabling the implementation of the methods 
described herein, and which - when loaded in a computer system - is able to carry out 
these methods. 
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Computer program means or computer program in the present context include any 
expression, in any language, code or notation, of a set of instructions intended to cause a 
system having an information processing capability to perform a particular function 
either directly or after conversion to another language, code or notation, and/or 
reproduction in a different material form. 

Thus the mvention includes an article of manufacture which comprises a computer usable 
medium having computer readable program code means embodied tiierein for causing a 
function described above. The computer readable program code means in tiie article of 
manufacture comprises computer readable program code means for causing a computer to 
effect the steps of a method of tiiis invention. Shnilarly, tiie present invention may be 
implemented as a computer program product comprismg a computer usable medium 
having computer readable program code means embodied therein for causmg a function 
described above. The computer readable program code means in the computer program 
product comprising computer readable program code means for causing a computer to 
effect one or more functions of this invention. Furthermore, the present invention may be 
unplemented as a program storage device readable by machine, tangibly embodying a 
program of instructions executable by the machine to perform method steps for causmg 
one or more functions of tiiis invention. 

It is noted that the foregomg has outlined some of the more pertinent objects and 
embodiments of the present invention. This mvention may be used for many 
applications. Thus, altiiough tiie description is made for particular arrangements and 
metiiods, tiie intent and concept of tiie mvention is suitable and applicable to otiier 
arrangements and appUcations. It will be clear to those skilled in the art that 
modifications to tiie disclosed embodunents can be effected witiiout departing from tiie 
sphit and scope of tiie invention. The described embodiments ought to be construed to 
be merely illustrative of some of the more prominent features and applications of tiie 
invention. Otiier beneficial results can be realized by applying tiie disclosed invention in 
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a different manner or modifying the invention in ways known to those familiar with the 
art. 
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CLAIMS: 

1 . A method comprising employing a vocab\ilary of color names in assigning a color 
name to a pixel in a digital representation, including the steps of: 

providing said vocabulary of color names with a plurality of color prototypes, 
each said color prototype having a prototype color name and a corresponding prototype 
color value; 

comparing a pixel color value of said pixel to said prototype color value of each 
color prototype in the vocabulary, and obtaining a color match value for said each color 
prototype in the vocabulary; 

determining a closest color match value resulting from said step of comparing; 

and 

assigning to said pixel a particular prototype color name correspondmg to said 
closest match value. 

2. A method as recited in claim 1, further comprising forming said vocabulary of color 
names, includes the steps of: 

obtaining at least one general set of essential color names, each essential color 
name having a corresponding color value; 

whereby each color name includes a hue descriptor, brightness modifier, and 
saturation modifier; and 

selecting a subset of said at least one general set in meeting an ^plication desire 

for said vocabiilary of color names. 

3. A method as recited in claim 2, wherein the step of obtaining includes starting with a 
large number of arbitrary color names having corresponding color values and modify 
them through subjective (perceptual) experiments to obtain a general set that models 
human behavior in color naming 



4. A method as recited in claim 1, wherein the step of comparing includes the steps of: 
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computing a color distance in a selected color space between the color value of 
said pixel and said prototype color value; 

finding the closest perceptual match to tiie prototype color value for said color 
distance; 

computing an estimate value of perceptual dissimilarity between said closest 
perceptual match and color value of said pixel; and 

using said estimate value to modify said color distance, thereby obtaining said 
color match value. 

5. A method as recited in claim 1, wherein the step of determining includes finding the 
prototype color value having the minim\mi color naming distance to the color value of 
said pixel. 

6. A method as recited in claim 1, further comprising: 

acquiring a digital representation of a scene; 

employing said vocabulary in providing a description of a color composition in 
said scene. 

7. An article of manufacture comprising a computer usable medium having computer 
readable program code means embodied therein for causing assignment of a color name, 
the computer readable program code means in said article of manufacture comprising 
computer readable program code means for causing a computer to ejffect the steps of 
claim 1. 

8. A program storage device readable by machine, tangibly embodying a program of 
instractions executable by the machine to perform method steps for assigning a color 
name, said method steps comprising the steps of claim 1. 



9. An apparatus comprising means for employing a vocabulary of color names in 
assigning a color name to a pixel in a digital representation, including: 
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means for providing said vocabulary of color names with a plurality of color 
prototypes, each said color prototype having a prototype color name and a corresponding 
prototype color value; 

means for comparing a pixel color value of said pixel to said prototype color value 
of each color prototype in the vocabulary, and obtaining a color match value for said each 
color prototype in the vocabulary; 

means for deternmiing a closest color match value resulting from said step of 

comparing; and 

means for assigning to said pfacel a particular prototype color name corresponding 
to said closest match value. 

10. An apparatus as recited in claim 9, further comprising means for forming said 
vocabulary of color names, including: 

means for obtaining at least one general set of essential color names, each 
essential color name having a corresponding color value; 

means for whereby each color name includes a hue descriptor, brightness 
modifier, and saturation modifier; and 

means for selecting a subset of said at least one general set in meeting an 
application desire for said vocabxilary of color names. 

11. An apparatus comprising: 

means for obtaining a vocabulary of color names; 

means for acquiring a digital representation of a scene; and 

means for employing said vocabulary in providing a description of a color 

composition in said scene. 



12,. Apparatus as recited in claim 11, wherein the means for providing includes means for 
employing color names in describing the scene and in describing objects m said scene. 
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13. A computer program product comprising a computer usable medium having 
computer readable program code means embodied therein for causing assigmnent of a 
color name to a pixel in a digital representation, the computer readable program code 
means in said computer program product comprising computer readable program code 
means for causing a computer to effect the functions of claim 9. 

14. A computer program product comprising a computer usable medium having 
computer readable program code means embodied therein for causing provision of a 
description of a color composition in a scene, the computer readable program code means 
in said computer program product comprising computer readable program code means for 
causing a computer to effect the functions of claim 1 1 . 

15. A method comprising: 

obtaining a vocabulary of color names; 
acquiring a digital representation of a scene; and 

employing said vocabulary in providing a description of a color composition in 
said scene. 

16. A method as recited in claim 1 5, wherein the step of providmg includes employing 
color names in describing the scene and in describing objects in said scene. 

17. A method as recited m claim 15, wherein the step of employing includes: 

computing a simplified representation of said scene to model a human perception 
of said scene; 

segmenting a digital image representing said scene into a set of meaningful 
regions; 

computing a perceived color value for each said meaningful region; 
assigning a region color name from said vocabulary to each said meaningful 

region; 
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using said region color names to describe the color composition of said scene at 
different accuracy levels; 

18. A method as recited in claim 15, further comprising computing a simplified 
representation of said scene corresponding to a human observation of said scene. 

19. A method as recited in claim 1 8, wherein the step of computing a simplified 
representation of said scene includes: 

applying a chromatic transformation to accommodate for a particular illumination 

condition of said scene; 

labeling said each pixel m said image with a label of a descriptive type to 
correspond with the descriptive type of an element of said scene to which said each pixel 
belongs; 

performing adaptive smootiiing of said image with an amount of smoothing 
around said each pixel in correspondence with the descriptive type of said each pixel; 

for said each pixel , determining whether said each pixel is a perceptually 
significant pixel or a perceptually insignificant pixels; and 

reapplying chromatic transformation to preserve a color appearance as perceived 
in said human observation. 

20. A method as recited in claim 1 9, wherein the step of labeling includes: 
determining if said each pixel in said image represents an edge; 
estimating distribution of edge density in a neighborhood of said each pixel in 

said image; and 

using said distribution to determine a descriptive type of said each pixel and 
labeling said each pixel accordingly. 

20. A method as recited in claim 19, wherein the descriptive type includes a type taken 
from a group of types including: uniform, noise, contour, region boundary, texture 
boundary, transition region, coarse texture, and fine texture. 
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21. A method as recited in claim 19, wherein said step of determining includes deeming 
said each pixel to be perceptually significant if said each pixel is at least one of: uniform, 
in a dominant object, in a dominant background, coarse texture and fine texture. 

22. A method as recited in claim 19, wherein said step of determining includes deeming 
said each pixel to be perceptually insignificant if said each pixel is at least one of: noise, 
contour, region boundary, texture boundary, and transition region. 

23. A method as recited in claim 19, wherein the step of labeling produces a label for said 
each pixel, and the step of smootibing includes: 

obtaining the label for said each pixel in said image; and 

using said label for said each pixel m determining a smoolhing filter to be used for 
said each pixel in said image. 

24. A method as recited in claim 19, wherein the step of smoothing is performed only on 
perceptually significant pixels. 

25. A method as recited in claim 23, further comprising changing said smoothing filter 
depending on a particular descriptive type of a particular pixel m a center of the 
smoothing filter. 

26. A method as recited in claim 23, wherein said support of a smoothing filter is largest 
for pixels labeled uniform and smallest for pixels labeled coarse texture. 

27. A method as recited m claim 17, wherein the step of segmentation includes at least 
one of the following: color segmentation, texture segmentation, region growing, region 
merging, region splitting, multiresolution segmentation. 



wo 2004/027695 




PCT/US2002/029974 



28. A method as recited in claim 17, wherein the step of computing a perceived color 
value for a meaningful color region includes: 

changing a pixel value of each perceptually insignificant pixel in said region into a 
new value equal to the pixel value of a closest perceptually significant pixel firom said 
region; and 

averaging color values of all pixels in said region. 

29. A method as recited in claim 17, wherein the step of assigning includes: 

providing said vocabulary of color names with a plurality of color prototypes, 
each said color prototype having a prototype color name and a corresponding prototype 
color value; 

comparing said perceived color value of each said meanmgfiil re^onto said 
prototype color value of each color prototype in the vocabulary, and obtaming a color 
match value for said each color prototype m the vocabulary; 

determining a closest color match value resulting firom said step of comparing; 

and 

assigning to said meanmgful region a particular prototype color name 
correspondii^ to said closest match value. 

30. A method as recited m claim 29, further comprising forming said vocabulary of color 
names, including the steps of: 

obtaming at least one general set of essential color names, each essential color 
name having a corresponding color value; 

wherein each color name inclvides a hue descriptor, brightness modifier, and 

saturation modifier; and 

selecting a subset of said at least one general set m meeting an appUcation desire 

for said vocabulary of color names. 



3 1 . A method as recited in claim 17, wherem the step of using mcludes: 
providing a set of rules defining accuracy levels m color namii^; 
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selecting an accuracy level meeting an application desire; and 

computing a histogram of color names for said scene, for said selected accuracy 

level. 

32. A method as recited in claim 31, further comprising forming said rules, includes the 
steps of: 

obtaining a set of accuracy levels describing human behavior in color naming; and 
deriving rules whereby color names and each accuracy level include at least one 
of: a hue descriptor, a combination of brightness modifiers, and a saturation modifier. 

33. A method as recited in claim 31, wherein the set of accuracy levels is determined 
employing subjective experiments modeling htunan behavior in color naming 

34. A method as recited in claim 31, wherein the step of computing a histogram of color 
names for said scene includes: 

detemiining color names present in said scene; 

computing a total area for each said color name; 

discarduig color names not meeting an area criterion; and 

combining color names according to said rule for said selected accuracy level. 



35. A method as recited in claim 34, fiulher comprising : 
providing color names for objects in said scene; and 
pointing out examples of named color in said scene. 



36. A method comprising computing a simplified representation of a scene consistent 
with human observation of said scene, including the steps of: 

applying chromatic transformation to accommodate for different illumination 
conditions; 

labeling pixels in said scene into different pixel types; 
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performing adaptive smoothing of said image where the amount of smoothing 
around each pixel depends on the type of said pixel; 

• determining perceptually significant pixels and perceptually insignificant pixels; 

and 

reapplying chromatic transformation to preserve the color appearance to the 
human observer; 

37. An article of manufacture comprising a computer usable medivim having computer 
readable program code means embodied therein for causing provision of a description of 
a color composition in a scene, the computer readable program code means in said article 
of manufacture comprising computer readable program code means for causing a 
computer to effect the steps of claim 15. 

38. A program storage device readable by machine, tangibly embodying a program of 
instructions executable by the machine to perform method steps for providing a 
description of a color composition in a scene, said method steps comprising the steps of 
claim 15. 

39. An article of manufacture comprising a computer usable medium having computer 
readable program code means embodied therein for causing provision of a description of 
a color composition in a scene, the computer readable program code means in said article 
of manufacture comprising computer readable program code means for causing a 
computer to effect the steps of claim 36. 

40. A program storage device readable by machine, tangibly embodying a program of 
instructions executable by the machine to perform method steps for providing a 
description of a color composition in a scene, said method steps comprising the steps of 
claim 36. 
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WW ImI^IIIi h^lWWillOII ^SlCljf 


7 Ovr 4 1 9 


tfRRftn^p 


64 Brownish Grav 

Wnr 1^1 WW 1 1 1 w 1 1 1 Gl V 


5 65r 4 n Q 

o-ooi o.*r 




65 Brownish Black 

Ww l^lwwwlllwil U|ICI\#f\ 


7 Rvr n fi n Q 

r .Oyi w.O 




66 Vivid Oranoe Yp^IIow 

WW VIVIVI ^^1 dl w 1 wil\/W 


R Rvr 7 1 9 




6T Brilliant OranoA Yiskilnw 

Wf wl lilldl 1 1> ^^idll^w 1 


0 1 V R 1 in 




6ft 5^tronn C^fs^r%nc^ YollniA/ 
wo wLiwiiiy v^idiiyt^ 1 Criiuw 


Q1vr71 11 R 




69 Deep Orange Yellow 


8.6yr6.0 12.1 


#D76E00 


70 Light Orange Yellow 


9.4yr 8.3 6.8 


#FFB961 


71 Moderate Orange Yellow 


8.7yr7.2 8.3 


#F7943C 


72 Dark Orange Yellow 


9.3yr 6.0 7.9 


#C37629 


73 Pale Orange Yellow 


9.2yr 8.7 4.4 


#FFCA86 


74 Strong Yellowish Brown 


8.8yr4.6 8.5 


#96500C 
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75 Deep Yellowish Brown c 


j.oyr o, 1 o.u 


iCQOO^C 1 


76 Light Yellowish Brown c 


^ T\/r ft K R n 
5- # yr D.o o.u 


!£RRRR^4 1 
rDDODO^r | 


^7 Moderate Yellowish Brown v 




!£7n'>19n 1 
rf UO 1 £LlJ I 


78 Dark Yellowish Brown ' 


A\ir O ^ 


Efopoc-io 1 


[79 Light Grayish Yellowish ^ 
iBrown 


D T\#r A O ^ 

3. / yr o.^ z.o 


ttR4R7R4 1 
rrDH-O # OH- 1 


|oO Grayish Yeiiowisn Drown 




ft785840 1 


|o1 Dark Grayisri Yeiiowisn orown 


a Q\/r 9 1 R 




|o2 Vivid Yellow 




#FFB300 

rri 1 1 


183 Brilliant Yellow 


d 4v R 7 R Q 




184 Strong Yellow 




#F5QF1F 1 


185 Deep Yellow 


7v Q Q 1 


#R57900 1 


186 Light Yellow 


4 '^x/ R R R R 


#FFn35F 1 


187 Moderate Yellow 


R\/ 7 1 R 


#D79D41 1 


|88 Dark Yellow 


o Qx, R n R 4 


*Rn7D2R 1 


89 Pale Yellow 


4 7\/ Q n R 


*FFnR8R 1 


|90 Grayish Yellow 


A Am 7 9 R 


ttnFA262 1 


|91 Dark Grayish Yeiiow 


R\/ Q 4 n 
o.oy *T.\j 


*A47C45 


192 Yellowish White 


4 '^w Q 9 1 9 


#FFE2B7 

rri 1 u^ibtL-/! 1 


Ids Yellowish Grav 


3.8y 7.4 1.4 


#CAA885 


94 Light Olive Brown 


2.1y4.9 7.9 


#945008 


95 Moderate Olive Brown 


2.7y 3.6 5.5 


#64400F 


96 Dark Olive Brown 


2.0y 1.9 2.2 


^302112 


|97 Vivid Greenish Yellow 


9.1y 8.2 12.0 


#F4C800 ' 


198 Brilliant Greenish Yellow 


9.8y 8.8 9.5 


#FFDC33 
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)9 Strona Greenish YaIIow 


9 2v 7 2 9 2 




100 DeeD Greenish Yellow 


9 2v 5 9 9 2 

\J \Jm\J yjm^ 




101 Liaht Greenish Yellow 


9 8v 8 9 7 0 


ftFFDESA 


102 Moderate Greenish Yellow 


9 5v 7 1 6 5 


#C4A43D 


103 Dark Greenish Yellow 

■ WW m^%Mm 1 1 w II 1 Wl 1 V/ W 


9 4v 5 9 6 3 




104 Pale Greenish Yellow 

1 i mw wwiiiwii I wii^/vv 


9 5v 9 0 4 2 




105 Gravish Greenish Yellow 


9 Ov 7 2 3 9 


#C4A55F 


106 Liaht Olive 


8 2v 5 1 5 6 


#846A20 


107 Moderate Olive 


7 6v 3 8 5 4 
f w-w w.*T 


tt5F4QnF 


108 Dark Olive 


8 9v 2 4 3 1 




109 Liaht Gravish Olive 


7 85v 5 5 2 5 


#8B734B 


110 Gravish Olive 


8 Ov 3 6 2 0 




111 Dark Gravish Olive 

III fx 1 ^ Y 1 w i 1 1 1 V w 


9 7v 2 0 1 8 


#282517 


112 Liaht Olive Grav 


6 9v 5 5 1 3 




113 Olive Grav 

1 IW %^iivw v^idy 


8 1v 3 5 0 9 


#4D4234 


114 Olive Blacic 


9 Ov 1 1 0 9 


#121910 


115 Vivid Yellowish Grppn 


5 4av 6 8 112 


#93AAnn 


116 Brilliant Yellow Green 


4.9gy 8.2 9.1 


#CED23A 


117 Strong Yellow Green 


5.4gy 6.0 8.7 


#7F8F18 


118 Deep Yellow Green 


7.4gy 4.2 7.1 


#425E17 


119 Light Yellow Green 


S.Ogy 8.4 5.6 


#DCD36A 


120 Moderate Yellow Green 


4.8gy 6.0 5.0 


#868940 


121 Pale Yellowish Green 


3.4gy 8.7 2.4 


#F0D698 


122 Grayish Yellowish Green 


4.4gy6.0 2.3 


#908458 


123 Strong Olive Green 


4.0gy 3.0 11.0 


#0A4500 
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124 Deep Olive Green * 


i^.Ogy 1.5 11.0 


*1 42300 


125 Moderate Olive Green > 


5.7gy 3.6 4.8 


IM34B1B 


126 Dark Olive Green < 


3.0gy 2.2 3.6 


fif232C16 


127 Grayish Olive Green 


4.6gy 3.5 2.0 


ISW8442D 


128 Dark Grayish Olive Green 


5.4gy2.0 1.8 ; 


IS^27261A 


129 Vivid Yellowish Green 


l.lg 5.9 11.2 


#379931 


130 Brilliant Yellowish Green 


0.3g 7.7 8.6 


#8CCB5E 


131 Strong Yellowish Green 


0.4g 5.4 8.7 


#478430 


132 Deep Yellowish Green 


0.9g 3.5 9.0 


#00541 F 


133 Very Deep Yellowish Green 


lO.Ogy 1.5 11 


#002800 


134 Very Light Yellowish Green 


0.2g 8.6 4.6 


#C6DF90 


135 Light Yellowish Green 


0.7g 7.4 5.2 


#007BA7 


136 Moderate Yellowish Green 


0.5g 5.5 4.8 


#657F4B 


137 Dark Yellowish Green 


0.6g 3.5 5.0 


#304626 


138 Very Dark Yellowish Green 


0.3g 1.8 4.3 


#132712 


139 Vivid Green 


3.2g 4.9 11.1 


#007D34 


140 Brilliant Green 


6.2g 6.5 8.3 


#47A76A 


141 Strong Green 


5.8g 4.4 8.7 


#006B3C 


142 Deep Green 


5.1g3.0 8.1 


#004524 


143 Very Light Green 


6.5g 7.8 4.9 


#98C793 


144 Light Green 


6.0g 6.4 5.1 


#719B6E 


145 Moderate Green 


6.3g 4.5 5.1 


#386646 


146 Dark Green 


6.6g 2.8 4.6 


#203A27 


147 Very Dark Green 


8.0g 1.8 3.0 


#162510 


148 Very Pale Green 


7.3g 8.8 1.9 


#D8DEBA 



Fig. 2F 
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149 Pale Green 


^.6g 6.4 1.7 


^f8D917A 


150 Grayish Green 1 


3.8g4.5 1.8 


fif575E4E 


151 Dark Greenish Yellowish 
Green 


I.Obg 2.9 1.8 


(5^313830 


152 Blackish Green 


10.0g 1.0 1.4 


^^141613 


153 Greenish White 


10.0g9.2 0.8 


«iF5E6CB 


154 Light Greenish Gray 

g A 


3.0g 7.5 0.9 


#BAAF96 


155 Greenish Gray 


7.5g 5.5 1.0 


#7A7666 


156 Dark Greenish Gray 


1.5bg 3.5 0.9 


#454338 


157 Greenish Black 


8.7g 1.0 0.7 


#181513 


158 Vivid Bluish Green 


5.0bg 5.0 13.0 


#00836E 


159 Brilliant Bluish Green 


2.9bg 6.0 9.6 


#009B76 


160 Strong Bluish Green 


4.6bg 4.5 8.5 


#006D5B 


161 Deep Bluish Green 


2.8bg 2.4 8.3 


#003828 


162 Very Light Bluish Green 


4.4bg 8.3 4.6 


#A0D684 


163 Light Bluish Green 


4.6bg 6.5 4.9 


#669E85 


164 Moderate Bluish Green 


4.6bg 4.5 5.0 


#2F6556 


165 Dark Bluish Green 


4.9bg 2.7 5.0 


#013A33 


166 Very Dark Bluish Green 


3.6bg 1.2 4.0 


#001 D1 8 


167 Vivid Greenish Blue 


5.0b 5.0 13.0 


#0078A7 


168 Brilliant Greenish Blue 


4.6b 5.9 7.7 


#2A8D9C 


169 Strong Greenish Blue 


4.9b 4.5 8.4 


#00677E 


170 Deep Greenish Blue 


5.0b 5.0 13.0 


#0078A7 


171 Very Light Greenish Blue 


4.0b 8.0 4.0 


#A3C6C0 


172 Light Greenish Blue 


4.5b 6.5 5.4 


#649A9E 



Fig. 2G 
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173 Moderate Greenish Blue ^ 


!^.7b 4.5 5.2 i 


^f30626B 


174 Dark Greenish Blue 


3.7b 2.7 5.0 i 


!^003841 


175 Very Dark Greenish Blue i 


5.0b 1.5 3.6 3 


1^022027 


176 Vivid Blue i 


5.0b 5.0 14.0 3 


f^007CAD 


177 Brilliant Blue 


1.6pb5.9 9.4 


^W285B4 


178 Strong Blue 


2.9pb4.1 10.4 


^00538A 


179 Deep Blue 


2.8pb 2.5 7.9 


#002F55 


180 Very Light Blue 


2.7pb 7.9 6.0 


#A6BDD7 


|l81 Light Blue 


1.6pb6.4 6.9 


#6C92AF 


|182 Moderate Blue 


S.Opb 4.3 6.8 


#395778 


183 Dark Blue 


2.2pb 1.7 5.5 


#002137 


184 Very Pale Blue 


1.5pb 8.3 3.3 


#C1CACA 


|l85 Pale Blue 


0.6pb 6.5 2.6 


#919192 


|l86 Grayish Blue 


0.2pb4.2 3.0 


#4A545C 


Il87 Dark Grayish Blue 


9.2b 2.7 2.0 


#2C3337 


|l88 Blackish Blue 


9.8b 1.3 1.5 


#161A1E 


189 Bluish White 


9.2b 9.1 1.2 


#F9DFCF 


190 Light Bluish Gray 


8.2b 7.5 1.0 


#BEADA1 


191 Bluish Gray 


8.9b 5.5 0.9 


#707460 


192 Dark Bluish Gray 


0.3pb 3.6 1.1 


#464544 


193 Bluish Black 


9.6b 1.1 0.8 


#151719 


194 Very Purplish Blue 


7.8pb 2.0 12.5 


#201 55E 


195 Brilliant Purplish Blue 


7.3pb 5.1 9.0 


#626396 


196 Strong Purplish Blue 


S.Opb 4.0 10.9 


#474389 


|l97 Deep Purplish Blue 


7.8pb 1.5 8.0 


#1A153F 



Fig. 2H 
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198 Very Light Purplish Blue 


7.4pb 7.6 5.2 


#BAACC7 


199 Light Purplish Blue 


7.3pb 6.0 6.5 


#837DA2 


200 Moderate Purplish Blue 


7.9pb 3.5 6.6 


#423C63 


201 Dark Purplish Blue 


S.Opb 1.3 4.3 


#1A162A 


202 Very Pale Purplish Blue 


7.0pb 8.0 3.7 


#CBBAC5 


203 Pale Purplish Blue 


7.0pb 6.0 3.9 


#8A7F8E 


204 Grayish Purplish Blue 


6.9pb 3.4 3.8 


#413051 


205 Vivid Violet 


2.0p 5.0 14.0 


#884BAE 


206 Brilliant Violet 


9.9pb 5.1 9.4 


#755D9A 


207 Strong Violet 


0.2p 3.7 10.1 


#53377A 


208 Deep Violet 


1.1p1.2 8.6 


#240935 


209 Very Light Violet 


2.0p 8.5 7.0 


#EEBEF1 


210 Light Violet 


0.5p5.6 7.1 


#876099 


211 Moderate Violet 


1.4p 3.6 7.0 


#543964 


212 Dark Violet 


1.4p 1.3 4.9 


#221 32B 


213 Very Pale Violet 


9.7pb 7.9 3.7 


#D8B1 BF 


214 Pale Violet 


1.3p6.0 4.0 


#957B8D 


215 Grayish Violet 


1.2p 3.3 3.9 


#463946 


216 Vivid Purple 


6.0p4.5 14.0 


#943391 


217 Brilliant Purple 


6.0p 7.0 11.0 


#DD80CC 


218 Strong Purple 


6.5p 4.3 9.2 


#803E75 


219 Deep Purple 


6.3p2.7 9.1 


#531A50 


220 Very Deep Purple 


6.0p 1.5 8.0 


#320B35 


221 Very Light Purple 


6.5p 7.8 5.1 


#E3A9BE 


222 Light Purple 


6.2p 6.5 6.5 


#BA7FA2 
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I223 Moderate Purole 


3.6p4.5 7.1 i 


!^7F4870 


l22d Dark Purole ' 


3.3p2.8 4.9 i 


i/472A3F 


I225 Verv Dark Purole ^ 


3.9p1.0 4.5 ? 


¥230D21 


226 Verv Pale Purole < 


5.5p 8.2 3.2 3 


^^E6BBC1 


I227 Pale Purole 


7.9p 6.4 3.1 


IS/iAE848B 


I228 Gravish Purole 


8.1p4.5 2.7 


#725250 


I229 Dark Gravish Purole 


0.5rp 2.8 2.0 


#452035 


l230 Blackish Purole 


0.8rp 0.9 1.6 


#101018 


231 Purolish White 


2.5rp 9.0 0.8 


#FA0BC8 


232 Liaht PurDlish Gray 


0.3rp7.5 1.1 


#C8A99E 


I233 Purolish Grav 


I.Orp 5.5 0.9 


#887066 


I234 Dark Purolish Grav 


1 .Orp 3.6 1 .0 


#564042 


I235 Purolish Black 


9.54p 0.9 0.6 


#161116 


1236 Vivid Reddish Purple 


I.Orp 3.0 14.0 


#7E0059 


I237 Strona Reddish Purole 


1.3rp4.4 10.2 


#9A366B 


1238 Deeo Reddish Purole 


I.Orp 2.8 9.5 


#641349 


I239 Verv Deeo Reddish Purole 


0.9rp 1.9 8.9 


#470736 


I24O Liaht Reddish Purole 


0.7rp 6.0 6.9 


#e66C8A 


1241 Moderate Reddish Purple 


0.8rp 4.5 7.0 


#804566 


1242 Dark Reddish Purple 


1.3rp 2.8 4.8 


#4F273A 


243 Very Dark Reddish Purple 


1.5rp 1.0 4.8 


#270A1 F 


244 Pale Reddish Purple 


1.3rp6.0 4.2 


#AO7580 


245 Grayish Reddish Purple 


I.Orp 4.5 4.2 


#704050 


246 Brilliant Purplish Pink 


6.0rp8.5 11.0 


#FF97B6 


I247 Strong Purplish Pink 


5.6rp 6.8 9.0 


#F6768E 
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248 Deep Purplish Pink 


4.4rp 6.0 12.2 


#EB5284 


249 Light Purplish Pink 


4.6rp 8.0 5.5 


#FFA8AF 


250 Moderate Purplish Pink 


4.6rp 6.8 6.7 


#E28090 


251 Dark Purplish Pink 


6.4rp 5.9 7.0 


#C76574 


252 Pale Purplish Pink 


3.7rp 8.4 3.3 


#FDBDBA 


253 Grayish Purplish Pink 


3.7rp 7.0 3.5 


#CC9293 


254 Vivid Purplish Red 


7.6rp4.9 13.6 


#052658 


255 Strong Purplish Red 


7.3rp4.4 11.4 


#832851 


256 Deep Purplish Red 


7.3rp2.6 10.1 


#6F0035 


257 Very Deep Purplish Red 


6.8rp 1.7 8.0 


#470027 


258 Moderate Purplish Red 


7.1rp 4.5 9.0 


#A73853 


259 Dark Purplish Red 


7.1 rp 2.7 6.0 


#581 E31 


260 Very Dark Purplish Red 


6.6rp 0.9 4.8 


#28071 A 


261 Light Grayish Purplish Red 


7.8rp 5.9 4.2 


#827070 


262 Grayish Purplish Red 


7.0rp4.5 5.1 


#8C4852 


263 White 


2.5pb 9.5 0.2 


#FFC9D7 


264 Light Gray 


6.7y 7.4 0.2 


#C2A894 


265 Medium Gray 


3.3gy 5.4 0.1 


#817066 


266 Dark Gray^ 


2.5pb 3.5 0.0 


#494230 


267 Black 


2.5pb 0.8 0.0 


#131313 



Fig. 2K 
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